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DETAILED ACTION 



Specification 



1. 



The title of the invention is not descriptive. A new title is required that is clearly 



indicative of the invention to which the claims are directed. 

Claim Objections 

Claims 18 ? 25, and 29 are objected to because of the following informalities: 

Claims 18, 25, and 29 recite the limitation "second" in line 1, line 2, and line 2, 
respectively. There is insufficient antecedent basis for this limitation in the claim. For 
examination purposes, the word "second" will be removed from the claim. 

Appropriate correction is required. 

Claim Rejections - 35 USC §102 
1 . The following is a quotation of the appropriate paragraphs of 35 U.S. C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 351(a) shall have the effects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 



2. 



Claims 1-8, 14-20, 31-34, and 38 are rejected under 35 U.S.C. 102(e) as being 



anticipated by Miyadera, US 6,133,951. 
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In regard to claims 1 and 19, Miyadera, US 6,133,951, discloses an image pickup 
device and control method for the device comprising: 

an image pickup section (see figure 2, element 8) which senses an optical image 
and converts said optical image into image information (see column 6, lines 21-25); 

a recognition section (see figure 2, element 1 1), which, if said optical image 
sensed by said image pickup section includes a medium displaying predefined 
information, recognizes said predefined information based on said image information 
obtained by said image pickup section (see figure 7A and column 9, line 4+); 

a storage section (see figure 2, element 43) which stores said predefined 
information recognized by said recognition section (see column 5, lines 25-29); and 

a processing section (figure 2, element 24) which performs at least one of 
controlling image sensing by said image pickup section based on said predefined 
information, processing image information based on said predefined information, and 
making said predefined information correspond to associated image information (see 
column 8, lines 58-60). 

In regard to claim 2, Miyadera, US 6,133,951, discloses the image pickup device 
of claim 1, wherein said predefined information is coded and displayed at said medium in 
a visually recognizable form (see figure 4 and column 6, lines 26-35). 

In regard to claim 3, Miyadera, US 6,133,951, discloses the image pickup device 
of claim 1, wherein said predefined information is one of text and an illustration 
displayed at said medium (see figure 4 and column 6, lines 26-35). 
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In regard to claim 4, Miyadera, US 6,133,951, discloses the image pickup device 
of claim 1, wherein said predefined information is any one of information relating to an 
image pickup condition of said image pickup section, information relating to processing 
of image information obtained by image sensing of said image pickup section, and 
information which is to be corresponded to image information obtained by image sensing 
of said image pickup section (see column 6, lines 38-48). 

In regard to claim 5, Miyadera, US 6,133,951, discloses the image pickup device 
of claim 4, wherein said information relating to said image pickup condition includes 
image pickup condition information which regulates said image pickup condition (see 
column 6, lines 38-48), and said processing section controls such that image sensing is 
performed by said image pickup section with said image pickup condition being 
regulated by said image pickup condition information (see column 8, lines 58-60). 

In regard to claim 6, Miyadera, US 6,133,951, discloses the image pickup device 
of claim 5, wherein said image pickup condition information is information which 
regulates at least one of a flash mode, an automatic exposure mode, turning automatic 
white balance adjustment on/off, and whether to allow saturation of gray tones at a 
highlighted area (see column 6, lines 38-48). 

In regard to claim 7, Miyadera, US 6,133,951, discloses the image pickup device 
of claim 5, further comprising a selector section which selects information, wherein said 
storage section is capable of storing a plurality of kinds of said image pickup condition 
information, and said processing section controls such that image sensing is performed by 
said image pickup section with said image pickup condition being regulated by image 
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pickup condition information selected, by said selector section, from said plurality of 
kinds of said image pickup condition information stored at said storage section (see 
column 9, lines 53-65). 

In regard to claim 8, Miyadera, US 6,133,951, discloses the image pickup device 
of claim 7, further comprising a display section (see figure 2, element 13), wherein said 
information relating to said image pickup condition includes title information which 
represents a title of said image pickup condition information, and said selector section 
displays, based on said title information, a title of a selectable image pickup condition at 
said display section (see column 8, lines 50-54: It is inherent the contents displayed 
describing the photography conditions display a title to differentiate the selected function 
from the others). 

In regard to claim 14, Miyadera, US 6,133, 951, discloses the image pickup 
device of claim 4, wherein said information relating to processing of image information 
includes at least one of processing condition information which regulates a processing 
condition of image processing on image information, title information which represents a 
title of said processing condition of image processing, and layout information which 
regulates a layout when image information representing an image is to be synthesized 
with other visually recognizable recordable information, and said processing section 
makes at least one of said processing condition information, said title information and 
said layout information to correspond to said image information (see column 8, lines 50- 
54: It is inherent the contents displayed describing the photography conditions display a 
title to differentiate the selected function from the others). 
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In regard to claim 15, Miyadera, US 6,133, 951, discloses the image pickup 
device of claim 4, wherein said information which is to be corresponded to said image 
information obtained by image sensing of said image pickup section includes at least one 
of classification information for classification of an image represented by said image 
information, text information which represents a text message which explains content of 
said image represented by said image information, and illustration information which 
represents an illustration to be added to said image represented by said image 
information, and said processing section performs one of making correspond to specific 
image information said information which is to be corresponded and synthesizing with 
said image information said information which is to be corresponded (see column 8, lines 
50-54). 

In regard to claim 16, Miyadera, US 6,133,951, discloses the image pickup device 
of claim 1, further comprising a first notifying section which notifies if said recognition 
section one of recognizes predefined information and recognizes absence of predefined 
information (see column 9, line 60 to column 10, line 3). 

In regard to claim 17, Miyadera, US 6,133,951, discloses the image pickup device 
of claim 1, wherein if said image pickup device is sensing an optical image that includes 
a medium displaying coded predefined information in a visually recognizable form (see 
column 6, lines 36-48), said image pickup section performs image sensing with a fixedly 
predetermined image pickup condition (see column 8, lines 58-60). 

In regard to claim 18, Miyadera, US 6,133,951, discloses the image pickup device 
of claim 1, further comprising a se con d notifying section which judges whether a medium 
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displaying coded predefined information in a visually recognizable form is included in 
said optical image sensed by said image pickup section, and notifies if said medium is 
judged to be included (see column 9, lines 53-65). 

In regard to clainr20, Miyadera, US 6,133,951, discloses an image processing 
method comprising the steps of: 

sensing, with an image pickup device provided with an image pickup section 
which senses an optical image and converts said optical image into image information 
(see column 6, lines 21-25), a medium displaying processing information which regulates 
processing content when image information is to be processed (see column 8, lines 50- 
54); 

inputting said processing information into said image pickup device by 
recognizing said processing information based on said image information obtained by 
image sensing and storing said processing information at a storage section (see figure 7A 
and column 9, line 4+); 

making said processing information correspond to specific image information (see 
figure 7 A and column 9, line 4+); and 

sending said specific image information corresponded to said processing 
information to an image processing device, such that said specific image information is 
processed by said image processing device with said processing content being regulated 
by said processing information (see column 8, lines 56-60). 

In regard to claims 3 1 and 38, Miyadera, US 6, 133, 95 1, discloses an image 
pickup device and method for controlling the device comprising: 
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an image pickup section (see figure 2, element 8), which senses an optical image 
and converts said optical image to image information (see column 6, lines 21-25); 

a recognition section (see figure 2, element 1 1) which, if said optical image 
sensed by said image pickup section includes a medium displaying predefined 
information in a visually recognizable first format, recognizes said predefined 
information based on said image information obtained by image sensing (see figure 7A 
and column 9, line 4+); 

a storage section (see figure 2, element 43) which stores said predefined 
information recognized by said recognition section (see column 5, lines 25-29); and 

an adder section (see figure 2, element 40) which, when an image represented by 
said image information is to be recorded on a recording material, adds said predefined 
information to said image information to provide information to be recorded on the same 
recording material in a second format which is different from said first format (see 
column 4, lines 18-29: It is inherent that the predefined information such as the shutter 
speed and aperture value is saved in a data format whereas the image information is 
saved in an image format on the memory card so that the data may be recovered from the 
memory card and processed correctly at a later time). 

In regard to claim 32, Miyadera, US 6,133, 951, discloses the image pickup 
, device of claim 31, wherein said first format is a bar code (see column 11, lines 40-41). 

In regard to claim 33, Miyadera, US 6,133, 951, discloses the image pickup 
device of claim 31, wherein identification information indicating kind of said predefined 
information is added to said predefined information, and said recognition section 
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recognizes said kind of said predefined information based on said identification 
information (see column 9, lines 53-65). 

In regard to claim 34, Miyadera, US 6,133, 951, discloses the image pickup 
device of claim 33, wherein said adder section decides said second format in accordance 
with said kind of said predefined information recognized by said recognition section, and 
adds information designating said second format to said image information with said 
predefined information (see column 4, lines 18-29: It is inherent that the predefined 
information such as the shutter speed and aperture value is saved in a data format 
whereas the image information is save in an image format on the memory card so that the 
data may be recovered from the memory card and processed correctly at a later time). 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

4. Claims 9-12 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Miyadera, US 6,133,951 in view of Kinjo, US 6,798,921. 

In regard to claim 9, Miyadera, US 6,133,951, discloses the image pickup device 
of claim 4. The Miyadera reference does not disclose that the information relating to 
processing of image information includes processing condition information which 
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regulates a processing condition of image processing on image information, and said 
processing section performs said image processing on image information with said 
processing condition being regulated by said processing condition information. 

Kinjo, US 6,798,921 discloses an image pickup device with processing 
subsections 62 and 66 which perform various known processing steps including: grey 
balance adjustment, tonal correction, density adjustment, color adjustment, scaling, 
dodging and sharpening (see column 6, lines 40-54). The amounts of adjustment of 
image processing conditions are calculated according to processing condition information 
commands for adjusting the density, color, contrast, sharpness, saturation, and other 
various parameters (see column 7, lines 29-36). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to have been motivated to modify Miyadera, US 6,133,951 in view of Kinjo, 
US 6,798,921, to have the information relating to processing of image information 
includes processing condition information which regulates a processing condition of 
image processing on image information, and said processing section performs said image 
processing on image information with said processing condition being regulated by said 
processing condition information in order to automatically set processing parameters and 
improve the image quality of the captured images. 

In regard to claim 10, Miyadera, US 6,133,951 in view of Kinjo, US 6,798,921, 
discloses the image pickup device of claim 9. The Kinjo reference discloses that the 
processing condition information is information which regulates at least one of a 
saturation enhancement degree, a sharpness enhancement degree, a processing condition 
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of color conversion processing, a processing condition of density conversion processing, 
and turning a particular image processing on/off (see column 7, lines 29-36). 

; In regard to claim 1 1, Miyadera, US 6,133,951 in view of Kinjo, US 6,798,921, 
discloses the image pickup device of claim 9, further comprising a selector section which 
selects information, wherein said storage section is capable of storing a plurality of kinds 
of said processing condition information, and said processing section performs said 
image processing on image information with a processing condition being regulated by 
processing condition information selected, by said selector section, from said plurality of 
kinds of said processing condition information stored at said storage section (see 
Miyadera: column 9, lines 53-65 and Kinjo: column 7, lines 29-36: When the data 
symbol is decoded as processing information the selector would select the appropriate 
process and parameters for the processor). 

In regard to claim 12, Miyadera, US 6,133,951 in view of Kinjo, US 6,798,921, 
discloses the image pickup device of claim 11. The Miyadera reference further 
comprises a display section (see figure 2, element 13), wherein said information relating 
to processing of image information includes title information which represents a title of 
said processing condition information, and said selector section displays, based on said 
title information, a title of a selectable processing condition at said display section (see 
column 8, lines 50-54: It is inherent the contents displayed describing the photography 
conditions display a title to differentiate the selected function from the others). 

5. Claims 13 and 21-30 are rejected under 35 ILS.C. 103(a) as being unpatentable over 

Miyadera, US 6,133, 951, in view of Anderson et al., US 6,097,431. 
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In regard to claim 13, Miyadera, US 6,133,951, discloses the image pickup device 
of claim 4. Miyadera does not disclose that the information relating to processing of 
image information includes layout information which regulates a layout when image 
information representing an image is to be synthesized with other visually recognizable 
recordable information, and said processing section synthesizes a portion or all of said 
image information representing said image with said other information in said layout 
regulated by said layout information. 

Anderson et al, US 6,097,43 1, discloses an image pickup device wherein the 
information relating to processing of image information includes layout information 
which regulates a layout when image information representing an image is to be 
synthesized with other visually recognizable recordable information (see figures 9-1 1 and 
column 6, lines 26-28: There are three layouts that can be displayed along with other 
image information including the frame number, shutter speed, image size and audio 
volume), and said processing section synthesizes a portion or all of said image 
information representing said image with said other information in said layout regulated 
by said layout information (see column 6, lines 18-25: Layout information is inputted by 
the user to command the processor to display the desired layout). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to have been motivated to modify Miyadera, US 6,133, 951, in view of 
Anderson et al., US 6,097,431, to have the data symbol include layout information which 
regulates a layout when image information representing an image is to be synthesized 
with other visually recognizable recordable information, and said processing section 
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synthesizes a portion or all of said image information representing said image with said 
other information in said layout regulated by said layout information in order to 
automatically display the preferred layout of the user out of several choices as the initial 
layout, saving the user time in operating the camera. 

In regard to claims 21 and 30, Miyadera, US 6,133,951, discloses an image 
pickup device and method for controlling the device comprising: 

an image pickup section (see figure 2, element 8), which senses an optical image 
and converts said optical image into image information (see column 6, lines 21-25); 

a recognition section (see figure 2, element 1 1), which, if said optical image 
sensed by said image pickup section includes a medium displaying predefined 
information, recognizes said predefined information based on said image information 
obtained by said image pickup section (see figure 7A and column 9, line 4+); 

a storage section (see figure 2, element 43) which stores said predefined 
information recognized by said recognition section (see column 5, lines 25-29); and 

The Miyadera reference does not disclose that the image information is layout 
information and that the image pickup device includes a generator section which, when 
image information of an image to be synthesized in accordance with said layout defined 
by said layout information is one of designated and inputted, generates one of composite 
image information, which represents a composite image in which said image to be 
synthesized is synthesized in accordance with said layout, and instruction information, 
which is for generation of said composite image information. 

Anderson et al, US 6,097,43 1, discloses an image pickup device wherein the 
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information relating to processing of image information includes layout information 
which regulates a layout when image information representing an image is to be 
synthesized with other visually recognizable recordable information (see figures 9-1 1 and 
column 6, lines 26-28: There are three layouts that can be displayed along with other 
image information including the frame number, shutter speed, image size and audio 
volume), and a generator section synthesizes a portion or all of said image information 
representing said image with said other information in said layout regulated by said 
layout information (see column 6, lines 18-25: Layout information is inputted by the user 
to command the processor to display the desired layout). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to have been motivated to modify Miyadera, US 6,133, 951, in view of 
Anderson et al., US 6,097,431, to have the image pickup device comprise: 

a recognition section which, if said optical image sensed by said image 
pickup section includes a medium displaying layout information which defines a 
layout employable during image synthesis, recognizes said layout information 
based on said image information obtained by image sensing; 

a storage section which stores said layout information recognized by said 
recognition section; and 

a generator section which, when image information of an image to be 
synthesized in accordance with said layout defined by said layout information is 
one of designated and inputted, generates one of composite image information, 
which represents a composite image in which said image to be synthesized is 
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synthesized in accordance with said layout, and instruction information, which is 

for generation of said composite image information; 

in order to automatically display the preferred layout of the user out of 

several choices as the initial layout, saving the user time in operating the camera. 

In regard to claim 22, Miyadera, US 6,133, 951, in view of Anderson et al., US 
6,097,431, discloses the image pickup device of claim 21, wherein said layout 
information is coded and displayed at said medium in a visually recognizable form (see 
Miyadera: figure 4 and column 6, lines 26-35: The layout information would be 
displayed as a data symbol like the other image information). 

In regard to claim 23, Miyadera, US 6,133, 951, in view of Anderson et al., US 
6,097,431, discloses the image pickup device of claim 21. The Anderson reference 
discloses further comprising a first selector section (see figure 8, element 264), wherein a 
plurality of kinds of layout information, which define mutually different layout patterns, 
are stored in said storage section, and said first selector section selects layout information 
to be used during image synthesis (see figures 9-1 1 and column 6, lines 26-28: There are 
three layouts saved in memory that can be selected and displayed along with other image 
information including the frame number, shutter speed, image size and audio volume). 

In regard to claim 24, Miyadera, US 6,133, 951, in view of Anderson et al., US 
6,097,43 1, discloses the image pickup device of claim 23. The Miyadera reference 
further comprises a display section (see figure 1, element 13), wherein title information 
which represents a title of a layout defined by layout information is added to said layout 
information, and said first selector section displays, based on said title information, a title 
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of a selectable layout at said display section (see column 8, lines 50-54: It is inherent the 
contents displayed describing the photography conditions display a title to differentiate 
the selected function from the others). 

In regard to claim 25, Miyadera, US 6,133, 951, in view of Anderson et al., US 
6,097,431, discloses the image pickup device of claim 21. The Anderson reference 
further comprises a second selector section (see figure 8, element 264), wherein a 
plurality of image synthesizable synthesis regions are provided in said layout defined by 
said layout information, and said second selector section selects a to-be-processed 
synthesis region from among said plurality of synthesis regions (see figures 9-11 and 
column 6, lines 26-28: There are three layouts saved in memory that can be selected and 
displayed along with other image information including the frame number, shutter speed, 
image size and audio volume). 

In regard to claim 26, Miyadera, US 6,133, 951, in view of Anderson et al., US 
6,097,43 1, discloses the image pickup device of claim 25. The Anderson reference 
further comprises a display section (see figure 8, element 280), wherein said second 
selector section displays said layout defined by said layout information at said display 
section such that an arrangement of said plurality of synthesis regions provided in said 
layout can be visually confirmed (see figure 9-11: Figure 9 displays the layout for the 
region selected by the selector section in figure 10 or 1 1). 

In regard to claim 27, Miyadera, US 6,133, 951, in view of Anderson et al., US 
6,097,431, discloses the image pickup device of claim 21. The Miyadera reference 
discloses wherein after image synthesis has been instructed, said image information of 
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said image to be synthesized in accordance with said layout defined by said layout 
information is inputted by said image pickup section sensing an optical image and image 
information obtained by image sensing being inputted (see column 8, lines 56-60). 

In regard to claim 28, Miyadera, US 6, 133, 95 1, in view of Anderson et al, US 
6,097,43 1, discloses the image pickup device of claim 21. The Miyadera reference 
further comprises a first designation section, which designates said image to be 
synthesized in accordance with said layout defined by said layout information from 
among a plurality of images whose image information has been stored in said storage 
section by optical image sensing by said image pickup section (see column 8, lines 56- 
60: The processor will designate the display layout based on the layout information from 
the data symbol.) 

) In regard to claim 29, Miyadera, US 6,133, 951, in view of Anderson et al., US 

6,097,43 1, discloses the image pickup device of claim 21. The Miyadera reference 
further comprises a s e cond designation section which designates as said image to be 
synthesized a partial region of a specific image whose image information is stored in said 
storage section, wherein said generator section generates one of said composite image 
information and said instruction information based on position, shape and size of said 
region designated by said s e cond designation section, such that only said region is 
synthesized as said composite image (see column 8, lines 56-60: The processor will 
designate the display layout based on the layout information from the data symbol). 

6. Claims 35-37 are rejected under 35 U.S.C. 103(a) as being unpatentable over 

Miyadera, US 6,133951 in view of Anderson, US 6,683,649, 
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In regard to claim 35, Miyadera, US 6, 133, 951, discloses the image pickup 
device of claim 3 1 . The Miyadera reference does not disclose that the predefined 
information is audio information, and said second format is an audio information 
representation format which represents said audio information such that sound 
represented by said audio information is easily reproducible. 

Anderson, US 6,683,649, discloses an image pickup device that can store one or 
more media types including images, video, audio, and text (see abstract). The images are 
stored in the mass storage device in image format (see column 6, lines 51-57) whereas the 
audio information is stored in Audio format (see column 6, lines 7-21). Icons are 
displayed on the screen indicating which media types are associated with a file (see figure 
4A). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to have been motivated to modify Miyadera, US 6,133951 in view of 
Anderson, US 6,683,649 to have the predefined information be audio information, and 
said second format is an audio information representation format which represents said 
audio information such that sound represented by said audio information is easily 
reproducible in order to add annotations or music to accompany an image. 

In regard to claim 36, Miyadera, US 6,133, 951, discloses the image pickup 
device of claim 3 1 . The Miyadera reference does not disclose that the predefined 
information is text information, and said second format is an image representation format 
which represents text represented by said text information as an image. 
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Anderson, US 6,683,649, discloses an image pickup device that can store one or 
more media types including images, video, audio, and text (see abstract). The images are 
stored in the mass storage device in image format (see column 6, lines 51-57) whereas the 
text information is stored in as a text media type or displayed with the image as a 
watermark (see column 7, lines 26-29). Icons are displayed on the screen indicating 
which media types are associated with a file (see figure 4A). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to have been motivated to modify Miyadera, US 6,133951 in view of 
Anderson, US 6,683,649 to have the predefined information is text information, and said 
second format is an image representation format which represents text represented by 
said text information as an image in order to annotate the image with preset messages so 
they do not have to be entered manually. 

In regard to claim 37, Miyadera, US 6,133, 951, discloses the image pickup 
device of claim 3 1 . The Miyadera reference does not disclose that the predefined 
information is illustration information, and said second format is an image representation 
format which represents an illustration represented by said illustration information as an 
image. 

Anderson, US 6,683,649, discloses an image pickup device that can store one or 
more media types including images, video, audio, and text (see abstract). The images are 
stored in the mass storage device in image format (see column 6, lines 51-57). Illustration 
information is stored to display the images and media icons on the display in a composite 
image in review mode (see figure 4A and column 7, lines 60-64). 
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It would have been obvious to one of ordinary skill in the art at the time of 
invention to have been motivated to modify Miyadera, US 6,133951 in view of 
Anderson, US 6,683,649 to have the predefined information is illustration information, 
and said second format is an image representation format which represents an illustration 
represented by said illustration information as an image in order for the user to be able to 
view multiple images at once, making it easier to select the desired image. 



Conclusion 

7. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. The following art discloses cameras that capture images of barcodes: 

US 6,747,692, 

US 6,512,919, 

US 5,845,166. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Gevell Selby whose telephone number is 703-305-8623 . The 
examiner can normally be reached on 8:00 A.M. - 5:30 PM (every other Friday off). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Andrew Christensen can be reached on 703-308-9644. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 




